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SPECIFICATION 

TITLE OF THE INVENTION 

TERMINAL APPARATUS AND IMAGE INFORMATION SERVER 



BACKGROUND OF THE INVENTION 

5 The present invention relates to an information 

uploading/downloading system, and it relates to, in particular, 
an uploading/downloading system of a pick-up image of a road 
condition, with utilizing a camera,, a navigation system, and a 
communication function provided in a vehicle, such as a car, etc. 

10 Conventionally, when driving a car, a car navigation system, 

etc., is used, for the purpose of obtaining information relating 
to the road on which the car will run from now. Also, with information 
relating to traffic jam and accidents, there was already invented 
a system, in which such the information is provided through the 

15 teletext (i.e., text multi-channel) of radio broadcasting, for 
example, so as to be displayed on a display of the car navigation 
system, thereby transmitting those to a user, for example, in 
Japanese Patent Laying-Open No. Hei 10-73441 (1998). 

With such the car navigation system, however, it is possible 
20 for a driver to know only about the road information, which was 
already registered in advance. Also, with such the information 
of the traffic jam and/or car accident, etc., it is impossible 
to transfer such information to the driver , swiftly and accurately, 
that is changing momently from one minute to the next, due to the 
25 time difference therebetween. In particular, such information as 
the traffic jam on a crossroad or a crossing, for example, just 
happening in the front, etc., i.e., the information that can be 
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seen easily, through a visual inspection through eyes approaching 
to the crossing, however in the advance of, it can be obtained 
only in a degree; e.g., in the form of information, in which the 
jamming area is displayed, separately, with different colors on 
5 the text or a map. 

BRIEF SUMMARY OF THE INVENTION 

An object, according to the present invention, is to provide 
a terminal apparatus and an image information server, on which 
the information can be confirmed, in advance, about the information 
10 of a place and so on, where a car will pass through from now, within 
a vehicle, such as a car, etc., thereby enabling a safe driving 
while keeping composure. 

For dissolving such the drawbacks mentioned above , according 
to the present invention, there is provided a terminal apparatus 

15 of a vehicle, such as a car, comprising: a position measuring means 
for measuring a present position; an image pick-up means, such 
as a camera, etc., being able to pick up an image of a front or 
a rear of the car; a transmitting means for uploading the image 
picked up, together with the position information, to an image 

20 information server for managing a database of image information 
being indicative of condition of a road; a receiver means for 
downloading a predetermined image from said image information 
server; and a display means for displaying said image received 
thereon, wherein: a place or a timing of picking up an image by 

25 said image pick-up means is controlled from said image information 
server. 

Also, according to the present invention, there is provided 
an image information server for managing a database of image 
information indicative of condition of a road, comprising: a 
30 terminal apparatus having, apositionmeasuringmeans for measuring 
a present position of a car, and an image pick-up means being able 
to pick up an image of a front or a rear of the car; a receiving 
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means for receiving the image picked up by said image pick-up means , 
together with the position information; and a transmitting means 
for transmitting a predetermined image to said terminal apparatus , 
wherein: a place or timing where or when said image pick-up means 
5 owned by said terminal apparatus picks up an image is controlled 
from said image information server. And, the image information 
indicative of the condition of the road, which is uploaded from 
each of the vehicles, is collected up to the image information 
server, while each of the vehicles downloads the information 
10 existing in the image information server when it is running. 

Further, according to the present invention, in the terminal 
apparatus as described in the above, an image indicative of 
condition of a road , being picked up when the car having said terminal 
apparatus passes through a first spot on the road designated in 

15 advance, is transferred to said image information server for 
managing the database of the image information indicative of road 
condition, and a terminal apparatus of a second car, which locates 
in a front of said first spot and will pass through said first 
spot, receives the image indicative of the condition of said first 

20 spot from said image information server, thereby enabling display 
of the image indicative of the condition of said first spot. With 
this, the car itself can confirm the condition of a spot through 
which it will run from now by using the information, which is picked 
up by other car passing through that spot just before. 

2 5 Also, according to the present invention, in the terminal 

apparatus as described in the above, a price including a 
predetermined point, etc. , can be obtained by picking up a condition 
of the road and/or transferring the image picked up to said image 
information server. And, also according to the present invention, 

30 a price including a predetermined point, etc. should be paid by 
receiving the predetermined image from said image information 
server and displaying said image received thereon. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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Those and other objects , features and advantages of the 
present invention will become more readily apparent from the 
following detailed description when taken in conjunction with the 
accompanying drawings wherein: 

5 Fig. 1 is a brief configuration view of a system according 

to an embodiment of the present invention; 

Fig. 2 is a view for explaining a scene of using , according 
to the embodiment of the present invention; 

Fig. 3 is a structure view of a portion , which is mounted 
10 on a car, according to the embodiment of the present invention; 

Fig. 4 is a structure view of a server, according to the 
embodiment of the present invention; 

Fig. 5 is a view for explaining uploading, according to the 
embodiment of the present invention; 

15 Fig. 6 is a flowchart of the uploading, according to the 

embodiment of the present invention; 

Fig. 7 is a view for explaining downloading, according to 
the embodiment of the present invention; 

Fig. 8 is a flowchart of the downloading, according to the 
20 embodiment of the present invention; 

Fig. 9 shows an example of a screen, according to the 
embodiment of the present invention; 

Fig. 10 is a view for showing a second embodiment of the 
present invention ; 

25 Fig . 1 1 is a view for showing a third embodiment of the present 
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invention; 

Fig. 12 shows an example of data management, according to 
the embodiment of the present invention; 

Fig. 13 shows an example of a money flow, according to the 
5 embodiment of the present invention; and 

Fig. 14 is a view for showing card information, according 
to the embodiment of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, embodiments according to the present invention 
10 will be fully explained by referring to the attached drawings. 
Fig. 1 shows a brief configuration of a system, according to an 
embodiment of the present invention. 

A reference numeral 10010 is a car, on which are mounted 
functions provided according to the present invention. A reference 

15 numeral 10011 is a camera for picking up the peripheries of the 
car. A reference numeral 10012 is a controller apparatus (MPU) 
for controlling the functions mounted on the car. A reference 
numeral 10013 is a communicator apparatus (RF) for conducting 
wireless communication. A reference numeral 10014 is a GPS for 

20 obtaining position information of the car. A reference numeral 
10020 is a communication network. A reference numeral 10030 is 
a server for conducting information management and image 
management /distribution at a provider side. A reference numeral 
10040 is other server, which is managed by the provider, etc. A 

25 reference numeral 10050 is a FM broadcasting station. And, 
reference numerals 10060 and 10070 are GPS satellites. 

On the car 10010, in which the present invention is applied, 
are mounted the camera 10011, the MPU 10012, the RF 10013, and 
the GPS 10014. The car 10010 on running is checked or confirmed 




on the present position thereof with using the GPS 10014. The MPU 
10012 takes communication with the server 10030 through the 
communication network 1002 0 , and determines timings (or places) 
of uploading and downloading of a pick-up image. When the MPU 10012 
5 determines that it is the timing for picking up an image , it gives 
an instruction thereof to the camera 10012. The image information 
picked up is uploaded through the RF 10014 and the communication 
network 10020 to the server 10030. In the similar manner, when 
the MPU determined that it is the timing for the downloading, it 

10 gives a request of downloading to the server 10030, thereby 
conducting the downloading through the communication network 10020 
and the RF 10014. Upon downloading, it is also possible to conduct 
the downloading of the information located in the other server 
1003 0. And, it is also possible to adopt a method of conducting 

15 the same through the FM broadcasting station 100050, but without 
using the communication network 10020. 

In Fig. 2 is shown a using method thereof, according the 
embodiment of the present invention. 

A car "A" 20010 picks up an image on a crossing 20040 during 
20 the running in the vicinity thereof, and uploads the picked up 
image (or the pick-up image) thereof. Through downloading the 
pick-up image 20030 of the crossing 20040, it is possible for a 
driver on a car "B" 20020 to know the road condition of the crossing 
2004 0, in advance, where the car will pass through from now. 

25 Fig . 3 shows the structure of appliances or equipments , which 

are mounted on the car, according to the embodiment of the present 
invention. A reference numeral 30010 is a CPU for controlling the 
appliances mounted on the car . Areference numeral 30020 is acamera. 
A reference numeral 3 0030 is a memory device, such as a DVD-ROM, 

30 a HDD, a memory card, etc. , for reserving therein a map information 
and preset information, etc. A reference numeral 30040 is the GPS. 
A reference numeral 30050 is an identification device, such as, 
a key for use of identification of a user , an IC card , etc . A reference 
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numeral 30060 is a communication device, such as a mobile telephone, 
etc., through which the communication is done with the server. 
A reference numeral 30070 is an input device, such as, a touch 
panel, and a keyboard, etc. A reference numeral 30080 is a display. 
5 A reference numeral 30090 is a receiver device, such as a FM tuner 
for the teletext broadcasting, a beacon receiver, etc. 

In this Fig. 2, the appliance on the car, always grasping 
the present position of itself with using the GPS 30040, has a 
function of picking up an image of the crossing in Fig. 2, with 
10 using the camera 3002 0, upon a request from the server, which will 
be mentioned later, and upon the present position information of 
itself, thereby transmitting it to the server with using the 
communication device 30060. 

Also, in the similar manner, it has a function of making 
15 a request of an image of the crossing, to which it is directing 
from now, to the server through the communication device 30060 
mentioned above, thereby displaying the image received on the 
display 30080. Those processes are conducted with using the CPU 
30010, and also the necessary inputs from the user are conducted 
20 with using the input device 3 0080. 

Fig. 4 shows the structure of the server side, according 
to the embodiment of the present invention. 

A reference numeral 40010 is a control server, which is 
provided by a system manger. A reference numeral 40011 is image 

25 pick-up information, to which reference is made when determining 
the image pick-up timing and/or the place for picking up an image 
thereof. A reference numeral 40012 is distribution information, 
to which reference is made when determining the information 
distribution timing and/or the place for distribution. A reference 

30 numeral 40013 is an image database for reserving the image 
information therein. A reference numeral 40014 is a map database 
for reserving the map information therein. A reference numeral 




4 0 0 1 5 is a user database for reserving the user information therein . 
A reference numeral 40020 is a control server, which is prepared 
by the provider , etc. A reference numeral 40030 is a communication 
network. And a reference numeral 40040 is a FM broadcasting station. 

5 The server conducts communication with the appliance or 

equipment mounted on the car, in accordance with an operation flow, 
which will be mentioned by referring to Fig . 5 and those thereafter , 
and it also conducts the following operations; such as, an 
instruction for image pick-up to the appliance on the car and/or 
10 receipt of the image data, transmission of images depending upon 
the requests from the appliance mounted on the car, and also the 
identification of the user accompanying therewith , as well as point 
calculations , etc . 

Explanation will be given on the embodiment, according to 
15 the present invention, by referring to Figs. 5, 6, 7, 8 and 9. 

First of all, explanation will be given on the uploading 
of the image picked up (i.e., the pick-up image), by referring 
to Figs. 5, 6 and 9. 

In Fig. 5, it is assumed that the cars are running on a road 
20 50010, in the order: a car "A" 50030, a car "B" 50040, a car "Y" 
50050, and a car "Z" 50060, for example. And, in this instance, 
all of the cars pass through a spot (a) 50011, a spot (b) 50012, 
a spot (y) 50 013, and a spot (z) 50014, in that sequence. In a 
server 50020, there is an image pick-up spot database 50021, into 
25 which is registered and/or set up an image picking up method, etc. 

As an example, explanation will be given on the processes 
conducted in each of the cars when passing through the spot (b) 
50012. 

Now assuming that: 
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the car "A" 50030 passes through at "8:00", and picked up 
the image of the spot; and 

the car "B" 5004 0 passes through' at "8:05", but picked up 
no image of that spot, 

5 then, at that time, the spot (b) database within the image 

pick-up spot database 50021 of the server 50020 is 50022. In this 
spot (b) database is set up/registered: an interval for issuing 
the image pick-up request (ten ( 10 ) minutes ) ; a final image pick-up 
time (8:00); a final passage time (8:05); and a final passage car 

10 ID (the car "B"). Since it is not necessary for all of the cars 
to pick up the image, therefore the request for image pick-up is 
made to a designated car at a certain time period or an interval. 
This certain time interval is variable, and at the spot (b), the 
time interval for issuing the image pick-up request is set at ten 

15 (10) minutes. 

Explanation will be given about the process flow of the car 
"Y" 50050, which will pass through the spot (b) 50012 next, by 
referring to Fig. 6, in this time. 

The car "Y" 50050 is always conducts "obtain position 
20 information, adjust" 60010 by using "GPS, map information" 60011. 
In "map information, image pick-up spot information" 60021 is 
registered an image pick-up spot, and in "correspond to image 
pick-up spot ?" 60020, it is determined on whether an image should 
be picked up or not. Herein, since the spot (b) 50012 is the image 
25 pick-up spot, therefore the position information is transmitted 
to the server 50012 in "transmit position information" 60030. 

In the server 50012, confirmation is made on whether 
"correspond to the image pick-up spot ?" or not in 60080, by using 
an "image pick-up spot information database" 60081. Herein, since 
30 the spot (b) 50012 is the image pick-up spot, "correspond to image 
pick-up timing ?" is determined, by using an "image pick-up 
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instruction information database" 60091. The "interval for issuing 
image-pick up request" at the spot (b) 50012 at this time is set 
at "ten (10) minutes", and the "final passage time" is "8:00". 
Because the car "Y" 50050 passed through at "8:10", and therefore 
5 already ten (10) minutes passes by from the time "8:00" of the 
"final passage time" , therefore the image pick-up request is issued. 
Instructing and controlling the timing for image pick-up from the 
server enables to reduce and amount of traffic of the transmission. 
The car "Y" 50050 receiving the image pick-up request conducts 
10 "image pick-up" 60040, and then "upload pick-up image" 60050. And, 
thereafter, it conducts "display point information" 60060 (a 
displaying example 90010) and then "end of process" 60070. 

In the server 50012 receiving the uploading, "reserve pick-up 
image" 60100 is conducted into a "pick-up image database" 60101. 
15 The image pick-up spot database at the spot (b) 50012 comes to 
be as indicted by 50023, after conducting "renew image pick-up 
instruction information database" 60110. "Add user point" 60110 
is conducted with respect to "user information database" 60121, 
and then "end of process" 60120. 

20 Next, explanation will be given about the downloading, by 

referring to Figs. 7, 8 and 9. 

In Fig. 7, it is assumed that a car "A" 70030, a car "B" 
70040, a car "Y" 70050 and a car "Z" 70060 are running on a road 
70010, in that order. In this time, it is also assumed that all 
25 of the cars pass through a spot (a) 70011 , a spot (b) 70012, a 
spot (y) 70013 and a spot ( z ) 70014, in that sequence. In the server 
70020 are provided a user information database 70021, a pick-up 
image database 7 0022, and an advertisement image database 70023. 

Explanation will be given on the processes in each of the 
30 cars, when passing through the spot (b) 70 012. 

The car "A" 70030 passing through the spot (b) 70012 makes 
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the image request to the server 70012. 

The information of the car "A" 70030 in the user information 
database 70021 is set to be "able to receive image" and "able to 
receive advertisement". As information of the spot (b) 70012 in 
5 the pick-up image database 70022, the image is registered, which 
was picked up at 7:50. As information of the spot (b) in the 
advertisement image database 70023 is registered an advertisement 
data. 

The server 7 0012 receiving the request conducts "image 
10 distribution" 70032 and "advertisement distribution" 70033 
conducts the advertisement. 

In the similar manner, in the car "B", as the information 
of the car "B" 70040 is registered only "able to receive image" 
in the user information database 7 0021, therefore only "image 
15 distribution" 70042 is conducted, but no advertisement 
distribution . 

Fig. 10 shows a second embodiment according to the present 
invention. 

In the embodiment explained hereinbefore, though the timing 
20 of picking up an image is so determined that, first the present 
position information is given from a side of the car to a aside 
of the server, for the server to determine on whether an image 
should be picked up or not, and then the image pick-up request 
is transferred to the side of the car, however, as a method for 
25 simplifying the processes of determining the image pick-up timing, 
it is also possible to utilize a fixed wireless communication 
apparatus, such as, a beacon, etc., which is located on a side 
of the road. 

The car (10010) picks up an image, on the chance of the image 
30 pick-up request given from a beacon 10012, and conducts uploading 
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thereof . Actually, the server conducts "search image pick-up spot" 
10080 by using the "image pick-up spot database" 10081, and it 
gives an instruction of requesting a start of picking-up of an 
image to the beacon located at the corresponding spot. Within the 
5 beacon receiving such the request, confirmation is made on whether 
the image pick-up timing is corresponding to or not (10020) by 
using the image pick-up instruction database 10021, and it issues 
the image pick-up request to the car if it corresponds thereto. 

In the car receiving such the request, it is determined on 
10 whether the image pick-up is possible (or available) ornot (10030) , 
and if being possible, it conducts the image pick-up (10040), 
thereby conducting the uploading thereof (10050). Thereafter, it 
conducts the point display (10060 ) , and the end of process ( 1007 0 ) . 

Receiving the uploading thereof, the server makes 
15 reservation (10090) of the pick-up image into the pick-up image 
database 10091, and it conducts addition of point (10100) to the 
user information database 10101 . Thereafter, in the end of process 
10110, renewal is conducted upon the image pick-up spot database 
10081, and the instruction is stopped for a moment to be given 
20 to the beacon, requesting the start of image pick-up. After passing 
by the image pick-up interval, which is registered in the image 
pick-up spot database 10081, the instruction is started, again, 
instructing the start of image pick-up to the beacon. 

Fig. 11 shows a third embodiment according to the present 
25 invention. 

In the first embodiment, though the information to be 
downloaded is the image registered for use of the passage spot, 
however also a method can be considered, in which the important 
information is distributed with priority, as a process when a car 
30 accident and/or a traffic jam occur. Ordinarily, the image being 
downloaded by the car "B" 11020 passing through the spot (a) 11030 
is the image of the spot (b) 11040. When the car accident happens 
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at the spot (c) 11050, however for the car "B" 11020, the important 
information is the image of the spot (c) 11050 where the car accident 
happens, than that image of the spot (b) 11040. 

As a method, the car "A" 11010 picks up an image of the spot 
5 (c) 11050, and the fact is added thereto that it is the important 
information, in a stage of conducting the uploading of the image 
11060, which is picked up through the user's operation. In the 
server 11090, when the important information is uploaded, thst 
information is transferred to amanagement agency or facility 11120, 

10 thereby to confirm on whether it is actually the important 
information or not. When determining that it is the important 
information, it gives a notice or information 11130 to a related 
agency 11140, such as, the police, etc. , and also at the same time, 
a notice of information 11110 to the server 11090, so that it 

15 distributes the information as the information to the periphery 
of the field where the accident occurs, giving priority thereto 
than the ordinary image thereof. 

Fig. 12 shows an example of data management. 

The databases, which are prepared on the server, include 
20 an image pick-up distribution spot database 12010, and the user 
information database 12090. 

The image pick-up distribution spot database 12010 is the 
database, for conducting set-up of a method for image distribution 
and registration of data, and it has information, each being aligned 
25 at every spots. Herein, in the spot (b) information 12020, there 
are included: image pick-up spot information 12030; image pick-up 
instruction information 12040; image pick-up car information 
12 050; pick-up image information 12060; and distribution 
information 12080 . 

30 In the user information database 12090 are registered the 

set-up information for each of the users. 
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Fig. 13 shows a money flow. 

The system is built up, by circulating the points , moneys 
and services, among three (3) parties; i.e., a system provider 
13 010, a sponsor undertaking 13020, and a user 13030, for example. 

5 The system provider 13 010 makes management upon the basis 

of the rental fee obtained from the user 13 030, advertising revenue 
obtained from the sponsor undertaking 13020, etc., and gives an 
assistance to the user 13030 for purchasing, by the means of the 
points. 

10 The sponsor undertaking 13020 pays advertising rate to the 

system provider 13010, as well as, fee for preferred selling right 
to the user 13030 , and it conducts the distribution of advertisement, 
selling of goods, etc., to the user 13030. 

For the user 13030 , an increase/decrease occurs on the points 
15 through using the services provided by the system provider 13010 
and the sponsor undertaking 13020, and the user can receive a 
discount of the service rental fee and/or the assistance for 
purchasing various equipments, depending upon the remaining amount 
of the points. 

20 Fig. 14 shows card information. 

The user can join into the present system by means of an 
IC card, i.e., through an IC card reader function mounted on the 
car. This is for the purpose of identifying the user her /himself , 
and there are registered the information for the identification 
25 and other information, such as the points, etc. 

The IC card described in the present embodiment, including 
MS (Master File) 14 010 as a root therein, has a plural numbers 
of DFs (Dedicated Files ) in the lower rank thereof . Thus, DF1 1402 0 
is a point card of a public corporation of road, which is used 
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in the present invention, and DF2 14 03 0 is used for the electronic 
money system, for example. Further, below the DF1, there are 
provided a plural numbers of EFs (Elementary Files); i.e., EFl 
is a public key or a secret key for use of conducting cryptography 
5 (or, ciphered communication) of the user ID and/or the personal 
information, and also is described therein the pint data that the 
user has, and so on. Within EF2 remains a record of processing 
history, in more details, a history of the points; for example, 
there is described such the information, that one (1) point is 
10 obtained through pick-up of an image and uploading thereof at 
Harajuku (i.e., an area name in Tokyo) crossing, and that twenty 
(20) points are consumed through the downloading of images on 
Yokohama Shindou (i.e., Yokohama new road). 

In the CPU card, the DF and the EF are made up with programs; 

15 therefore it is only possible to read out detailed information 
therefrom, or rewrite the history of infringement or violation, 
when a specific command is inputted from an outside thereof. This 
specific command can be done by means of software for exclusive 
use thereof, or a chip for exclusive use thereof which will be 

20 mentioned later. With this, it is possible to keep the secrecy 
of an inside information of the card, and to prevent it from change 
thereof. Also, for giving guarantee on the times of those 
information, a reliable clock 14060 may be provided within the 
card, thereby giving guarantee on the time information attached 

25 with the information, by using this. This clock, with using the 
characteristics of the CPU card mentioned above, steps on the 
processes of using the accurate time information obtained from 
the GPS, etc. , but without change, thereby being able to keep the 
time information, being always accurate. 

30 As was fully explained in the above, according to the present 

invention, for the driver of a car, since being possible to confirm 
the information about the spot where the car will pass through 
from now, in advance, therefore it is possible to drive the car 
safely, while keeping composure. Also, for investments, such as, 
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being paid for the camera and the communication equipments, etc. , 
which are mounted on the car, it is supported or subsided by means 
of the points, and the user can obtain the point through the use 
of the equipments , simply but without bearing such the investments, 
5 therefore being able to collects the investments for the equipments , 
and for the service system, there is no necessity of providing 
the cameras at each crossings by itself, but it is possible to 
obtain the images of the crossings in a real-time base and with 
ease, thereby using them effectively for the purpose of management 
10 of information of such the traffic jam; therefore it is possible 
to guarantee a mutual profit for both of them. Further, instructing 
and controlling the timing for picking up the image from the server 
brings about reduction in an amount of traffic of the transmission. 

According to the present invention, it is possible for a 
15 driver to confirm the information, while staying within a vehicle, 
such as a car, for example, about a spot, etc. , where the car will 
pass through from now, in advance and with ease, thereby achieving 
a safe driving while keeping composure. 

The present invention may be embodied in other specific forms 
20 without departing from the spirit or essential feature or 
characteristics thereof. The present embodiment ( s ) is /are 
therefore to be considered in all respects as illustrative and 
not restrictive, the scope of the invention being indicated by 
the appended claims rather than by the forgoing description and 
25 range of equivalency of the claims are therefore to be embraces 
therein. 



